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STOCHASTIC  COMPARISONS  OF  ORDER  STATISTICS, 
WITH  APPLICATIONS  IN  RELIABILITY 

by 

Jee  Soo  Kim,  Frank  Proschan,  and  Jayaram  Sethuraman 


ABSTRACT 

This  is  an  invited  paper  to  appear  in  the  special  issue  of  Communications  in  Statistics  : 
Theory  and  Methods  devoted  to  “Order  Statistics  and  Applications”.  This  paper  reviews  recent 
developments  in  stochastic  comparisons  of  order  statistics. 
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An  impressive  array  of  papers  has  been  devoted  to  inequalities  and  stochastic  ordering  of 
linear  combinations  and  partial  sums  of  order  statistics  and  comparison  of  their  expectations. 
In  this  paper  we  survey  recent  advances  in  stochastic  comparisons  of  order  statistics  along  with 
reliability  applications. 


Section  2  presents  inequalities  for  linear  combinations  of  order  statistics  from  restricted  fam¬ 
ilies  ,  obtained  by  Barlow  and  Proschan  (1966a)/ Comparisons  of  linear  combinations  of  order 
statistics  from  distributions  F  and  G  are  obtained  for  G*lF  convex  and  for  G~lF  starshaped. 


These  results  yield  conservative  upper  and  lower  tolerance  limits.  For  G  exponential  and  F  IFR 

:’/■  ;  /'  ,  •'  J-  v •-*  . 

or  IFRA,  we_present  stochastic  comparisons  for  the /total  time  on  test*/  used  in  life  testing. 


We  introduce  the  notions  of  majorization  and  Schur  function.  Because  majorization  leads  to 
many  inequalities,  these  notions  will  be  exploited  extensively  in  the  ensuing  sections. 


'Section  3  presents  stochastic  comparisons  of  order  statistics  from  underlying  heterogeneous 
distributions.  Given  two  sets  of  independent  components  (possibly  unlike),  majorization  condi- 
tions  are  given^by  Pledger  and  Proschan  (1971)  which  insure  that  any  fc-out-of-n  system  con¬ 
structed  from  components  in  the  first  set  will  have  reliability  at  least  as  great  as  that  of  a 
corresponding  system  constructed  from  components  in  the  second  set.  Since  the  ordered  failure 
times  of  the  components  represent  order  statistics  from  heterogeneous  distributions,  the  order 
statistics  from  one  set  of  underlying  distributions  {Flf  -  •  •  ,Fn}  can  be  compared  stochastically 

' '  r» 

with  those  from  another  set  •  •  • ,  F*}. 


We  present  additional  comparisons  involving  spacings  between  order  statistics.  In  some  of  the 
comparisons,  the  underlying  heterogeneous  distributions  are  compared  with  a  single  underlying 
homogeneous  distribution,  while  in  others,  they  are  compared  with  another  set  of  distributions 
less  heterogeneous  in  the  sense  of  majorization.  These  results  of  Pledger-Proschan  can  be  used 
to  approximate  the  reliability  of  certain  types  of  systems  of  unlike  components  by  computing  the 
reliability  of  corresponding  systems  of  like  components. 


The  main  theme  of  Section  4  is  a  result  of  Proschan  and  Sethuraman  (1976).  They  stochas¬ 
tically  compare  whole  vectors  of  order  statistics,  assuming  F\ ,  •  •  • ,  Fn(F * ,  •  •  ■ ,  F*)  have  propor- 
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tional  hazard  functions  with  Ai,  •  •  • ,  An(Ai,  •  •  • ,  A* )  as  the  constants  of  proportionality.  Pledger 
and  Proschan  (1971)  stochastically  compare  X(r)  and  X*rj  separately  for  each  r;  these  results  can 
be  obtained  as  special  cases  of  the  Proschan-Sethuraman  (1976)  results. 


Finally,  an  extension  of  stochastic  comparison  of  random  vectors  to  stochastic  comparison  of 
random  processes  is  presented. 

Throughout  we  use  the  term  increasing  (decreasing)  for  nondecreasing  (nonincreasing). 

2.  INEQUALITIES  FOR  LINEAR  COMBINATIONS  OF  ORDER  STATISTICS. 

Stochastic  comparisons  are  made  for  linear  combinations  of  order  statistics  from  F  and  G 
when  F  is  convex  with  respect  to  G  (i.e.,  G~1F(x)  is  a  convex  function  on  the  support  of  F, 
assumed  an  interval)  and  when  F  is  starshaped  with  respect  to  G  (i.e.,  G~lF(x)  is  a  starshaped 
function).  The  concept  of  F  being  convex  with  respect  to  G  was  introduced  in  van  Zwet  (1964) 
and  the  concept  of  F  being  starshaped  with  respect  to  G  is  discussed  in  Barlow  and  Proschan 
(1981). 

We  adopt  the  following  notation  and  assumption.  Let  X(Y)  have  distribution  F(G).  We 
assume  that  F(0)  =  0  =  G(0),  and  that  F  and  G  are  continuous.  We  assume  also  that  the 
support  of  F  is  an  interval,  possibly  infinite,  and  that  G  is  strictly  increasing  on  its  support.  We 
use  F  for  1  —  F  and  G  for  1  —  G. 

A  positive  function  h.  is  starshaped  on  [0, 6),  0  <  b  <  oo,  if  h(x)/x  is  increasing  for  x  in  [0,6), 
or  equivalently,  if  h(ax)  <  ah(x)  for  0  <  a  <  1,0  <  x  <  6. 

A  failure  rate  r(t )  at  time  t  is  defined  as  r{t )  =  f(t)/F(t)  when  density  f(t )  exists  and  F(t)  > 
0.  We  say  F  has  an  increasing  failure  rate  (IFR)  if  r(f)  is  increasing  in  t  and  F  has  a  decreasing 
failure  rate  (DFR)  if  r(f)  is  decreasing  in  t. 

A  rariom  variable  X  is  said  to  be  stochastically  smaller  than  a  random  variable  Y  (denoted 
by  X  <*‘  Y)  if  (P(X  >  t)  <  P(Y  >  t)  for  every  real  number  t.  We  say  X  is  stochastically 
equal  to  Y(X  =9t  Y)  if  P(x  >  t)  =  P(Y  >  t)  for  each  real  t.  We  stochastically  compare  linear 
combinations  of  order  statistics  Xjx)  <  •••  <  X(n)  from  F  and  Y{i)  <  •••  <  y(n)  from  G  when 
G~lF  is  starshaped  as  well  as  when  G~lF  is  convex  on  the  support  of  F. 


First  we  consider  pairs  of  distributions  F  and  G  such  that  G  lF  is  starshaped  on  the  support 
of  F.  Barlow  and  Proschan  (1966a)  proved  the  following  two  lemmas  which  are  fundamental  tools 

n 

in  obtaining  stochastic  inequalities.  We  shall  find  it  convenient  to  define  A+  =  y^qy,  where  the 

»=. i 

a.j  represent  real  numbers. 

n 

Lemma  2.1,  h(^^a,iXi)  <  ^”=1  o*h(xi)  for  all  starshaped  h  on  [0,6)  and  all  0  <  xi  •  •  •  <  xn  <  6 

x-l 

n 

for  which  0  <  y^Oj-Xi  <  6  if  and  only  if  there  exists  k(  1  <  k  <  n)  such  that  0  <  Ai  <  •  •  •  <  Ak  <  1, 

i  =  1 

and  when  k  <  n,  Ak+ 1  =  •  •  •  =  An  =  0. 

n  n 

Lemma  2.2.  >  y^ajA(xi)  for  all  starshaped  h  on  [0,6)  and  all  0  <  xi  •  •  •  <  xn  <  6 

»=i  »=i 

n 

for  which  0  <  y^q^xy  <  6  if  and  only  if  there  exists  k(l  <  k  <  n)  such  that  Ai  >  •  ■  •  >  Ak  > 
»=  1 

1;  Afc+i  =  •  •  •  =  An  =  0.  If  F  is  starshaped  with  respect  to  G,  then  by  Lemma  2.1 

G-‘r(i>*«>)  ^  E<kG-‘F(X-(j))  =*• 

'»=  1  '  t=l  i=l 

This  will  be  formally  stated  as  follows. 

Theorem  2.1.  (Barlow  and  Proschan,  1966a).  Let  G~iF  be  starshaped  on  the  support  of  F, 
F(0)  =  0  =  G(0).  If  there  exists  k(  1  <  k  <  n)  such  that  0  <  A\,  <  •  •  •  <  Ak  <  1,  and  when 
k  <  n,  ^4/t+i  =  •  •  •  =  An  =  0,  then 


*’(l>*w)  <*'  G(X>1W- 

\  =  1  '  i=  1 


From  Lemma  2.2  one  may  obtain  the  reverse  inequality  of  (2.1).  By  assumption,  the  support  of 

n  n  n 

F  is  an  interval,  say  [0,6].  If  ^q^y)  >  6,  then  F(^qyX(y))  =  1  >  G(y^aiy(l)).  Considering 

»=1  »  =  1  X—  1 

outcomes  for  which  EqyX(y)  <  6,  Lemma  2.2  leads  to 

G'lf('Ea‘x(‘))  2  £>c-‘r(*w)  ="  !>*(». 

'i=l  '  »=1  i-i 

The  above  discussion  is  summarized  in  the  following  theorem  due  to  Barlow  and  Proschan. 

Theorem  2.2.  Let  G~lF  be  starshaped  on  the  support  of  F  and  ,F(0)  =  0  =  G(0).  Let  qy  >  0 
for  t  =  1, 2,  •  •  •  ,n  and  an  >  1.  Then 

>"G(E«.y(i|)-  (2-2) 


_  iC  /  /  •  *  “  ■  •  •  »  »  '  •  *  ■  *  •  •  •  ■  1  -  *  •  »'»»*  *  •  »  •  » *  *'«•»*»  'w  '  1 


Similar  inequalities  can  be  obtained  for  pairs  of  distributions  F  and  G  such  that  G~lF  is  convex  on 
the  support  of  F.  This  is  a  strengthening  of  the  starshapedness  hypothesis.  Barlow  and  Proschan 
(1966a)  present  detailed  discussions  of  the  following  theorems,  which  assume  F  is  convex  with 
respect  to  G. 

Theorem  2.3.  Let  G~lF  be  convex  on  the  support  of  F,  F( 0)  =  0  =  (7(0),  and  0  <  A{  <  1  for 
t  —  1,2 , •  •  •  ,n.  Then 

F(l>Xw)  (2-3) 

Theorem  2.4.  Let  G~lF  be  convex  on  the  support  of  F ,  F(0)  =  0  =  (7(0),  and  for  some 
fc(0  <  k  <  n),Ai  >  1  for  t  =  1,  •  •  • , k  and  Ai  <  0  for  t  =  k  +  1,  •  •  • ,  n.  Then 

(24) 

N=1  '  'i=l  ' 

n  n 

From  the  simple  identity  =  ^Oj(x»  —  X,_i),  one  may  verify  (2.3)  and  (2.4)  are  equivalent 

»= i  »= l 

to 

■  n  n 

d)  <•' (>•*)<?  ■ 

s=i  -I  s=i 

An  important  problem  in  statistical  reliability  theory  and  life  testing  is  to  obtain  tolerance  limits 
as  a  function  of  sample  data.  The  above  inequalities  can  be  used  to  construct  conservative  lower 
or  upper  tolerance  limits  for  IFR  and  IFRA  distributions.  Confidence  limits  for  DFR  and  DFRA 
distributions  can  also  be  obtained  using  the  same  techniques.  See  Barlow  and  Proschan  (1966b). 

Let  G(t)  =  1  —  e~t,t  >  0.  Then  G~lF  starshaped  on  the  support  of  F  is  equivalent  to  F 
having  an  increasing  failure  rate  average  (IFRA).  We  now  discuss  results  concerning  “total  time 
on  test”  when  successive  observations  are  taken  from  an  IRFA  (DFRA)  distribution. 

If  n  items  are  put  on  life  test  and  the  test  terminated  at  the  time  of  the  rth  failure  (Type  - 

n 

II  censored  sampling),  then  Trn  =  ^(n  —  *  +  1)(X(,)  —  Xji-!))  represents  the  total  time  on  test. 

»=i 

This  statistic  has  been  extensively  studied  and  applied  in  the  case  of  the  exponential  distribution 
by  Epstein  and  Sobel  (1953)  and  Epstein  ( 1960a, b).  The  best  estimate  of  the  mean  6  in  the 
exponential  case  is  ^(x)  =  Trn/r. 

Now  let  F  be  IFRA  (DFRA),  F(0)  =  0,  and  E(X)  =  6.  Then  Barlow  and  Proschan  (1966a) 
show  that  the  total  time  on  test  divided  by  the  sample  mean  associated  with  F  is  stochastically 


larger  (smaller)  than  that  associated  with  the  exponential  distribution,  i.e., 


-  *  +  1) (A-(0  -  X(i-i,)/rJf  >«  (<“)  -  *  +  l)(V(i)  -  Y{i-i))/rY- 

i=  1  »=1 

In  the  case  of  the  exponential  distribution,  the  normalized  spacings  (n  —  i  +  l)(F(t)  -F(i_i))  are 
independent  and  identically  distributed  for  i  =  l,...,n  and  n  >  1.  Thus  one  might  expect  that 
the  spacings  would  exhibit  certain  montonicity  properties  for  distribution  F  such  that  G~lF  is 
convex.  Barlow  and  Proschan  (1966a)  show  that  if  F  is  IFR  (DFR)  with  F(0)  =  0,  then  (n  —  i  + 
l)(AT(i)  -  A^-l))  is  stochastically  increasing  (decreasing)  in  n  >  i  for  fixed  z.  We  can  establish 
as  a  corollary  that  if  F  is  IFR(DFR),  then  the  spacing  (n  —  t  +  l)(X(i)  —  X(;_i))  is  stochastically 
decreasing  (increasing)  in  *  =  1, 2,  •  •  • , n  for  fixed  n.  For  example,  (n  —  z)(X(2)  —  AT(i))  nX(i)i 
where  X(0)  =  0.  See  Barlow,  Marshall,  and  Proschan  (1969)  for  further  discussion  of  inequalities 
involving  starshaped  and  convex  functions.  Chan,  Proschan  and  Sethuraman  (1983)  consider  an 
ordering  different  from  the  van  Zwet  convex  ordering.  They  say  that  F  is  more  convex  than  G ,  in 
symbols  F  >c  G ,  if  FG~l(t )  is  a  convex  function  on  (0,1).  When  F  and  G  have  density  functions 
/  and  g ,  respectively,  they  show  that  F  >c  G  if  and  only  if  is  an  increasing  function  of  x, 
thus  relating  the  concept  of  increasing  likelihood  ratios  to  convex  ordering. 


An  extremely  powerful  and  useful  concept  for  deriving  a  great  variety  of  inequalities  is  the 
concept  of  majorization. 


k  k 

Definition  2.1.  Let  ai  <  flo  •  •  •  a„.b\  ^  bo  >  •••&„.  ^  E  bj  for  k  =  1, 2,  •  •  • ,  n  —  1,  and 

i—  i  3= i 

n 

aj  =  Then  a  =  (ol5  •  •  ■  ,an)  is  said  to  majorize  b  =  (6j_ ,  •  •  •  ,6n),  written  a  >Tn  b. 

j-i 

Definition  2.2.  Let  4>{a)  >  <^>(6)  whenever  o  >m  6.  Then  <t>  is  called  a  Schur  function. 


Theorem  2.4.  (Schur  (1923),  Ostrowski  (1952)).  Let  4>(x )  be  a  differentiable,  real-valued  function 
of  n  real  variables.  Then  <f>  is  a  Schur  function  if  and  only  if  ( Xi  —  Xj){-§£-  —  •§£■)  >  0  for  all  x 
and  all  i  ^  j. 


For  a  systematic  treatment  of  the  theory  of  majorization  and  its  applications  in  mathematics 
and  statistics,  see  Marshall  and  Olkin  (1979).  The  concept  of  majorization  has  been  extended  to 
elements  of  Li(0, 1)  in  Ryff  (1963)  and  the  Schur-Ostroswski  theorem  for  Schur  functionals  has 
been  obtained  in  Chan,  Proschan  and  Sethuraman  (1987). 


Marshall,  Olkin  and  Proschan  (1967)  determine  conditions  on  (01,02,  •  ■  •  ,an)  and 

n  n 

(61,62,-  •  -6n)  for  the  monotonicity  of  the  ratio  of  means;  g(r)  =  (^a£/^6[)1/r.  We  next  show 

*=  1  t=i 

that  one  application  of  this  monotonicity  yields  a  stochastic  comparison  between  a  function  of 
order  statistics  from  an  IFRA  distribution  and  the  same  function  of  order  statistics  from  the 
exponential  distribution.  For  notational  simplicity,  we  write  (j^r)  =  (^7,  •  •  • , 

We  know  that  Ex  log  x  is  a  Schur  function.  Thus  to  show  g(r)  is  increasing  in  r,  or  equivalently, 
dlogg(r)/dr  >  0,  it  is  sufficient  that  (^)  >m  (^),  where  a.i  =  a £  and  ft  =  6[(for  r  >  0)  and 
where  =  <_i+1  and  ft  =  brn_i+l  (for  r  <  0),  t  =  1,2,  •  •  •  ,n. 

Marshall  et  al.  (1967)  obtain  the  following  theorem. 

Theorem  2.5.  If  >  0,  >  0,ft  >  •••  >  ft  >  0,  £  <  •••  <  then  (^)  (^). 

Using  Theorems  2.4  and  2.5,  Marshall  et  al.  (1967)  prove  the  monotonicity  of  </(r).  We  will  see 
how  these  results  are  used  in  making  stochastic  comparisons  involving  the  order  statistics  from 
distributions  F  and  G,  where  F  is  starshaped  with  respect  to  G. 

An  important  example  in  which  the  conditions  of  Theorem  2.5  are  satisfied  is  obtained  by 
choosing  a,  =  <£(ft),  where  4>  is  a  nonnegative  starshaped  function.  We  note  that  a  nonnegative 
starshaped  function  <j>  must  be  increasing  and  must  satisfy  <£(0)  =  0.  Such  functions  are  discussed 
by  Bruckner  and  Ostrow  (1962).  Assume  that  ft  >  •  •  •  >  ft  >  0;  it  follows  that  aq  =  <?!>(ft)  > 
•  •  •  >  a„  =  <£(ft)  >  0.  Thus  by  Theorem  2.5, 


(JL)  =  ( 

[Z4>{0) 


)  >m  (A)- 

VEft 


(2.5) 


Let  X(i)  >  >  Xn  be  order  statistics  from  F.  Then  from  (2.5)  we  have  for  any  starshaped 

function  <f>  >  0  that 


,*u)  ip y, 

{EXi'  'ZXj-  '£*(*<)’  'E4>(Xi)'' 


Consequently,  if  F  is  starshaped  with  respect  to  the  distribution  G,  and  Yi  >  •  •  ■  >  Yn  are  order 

k  n  k  n 

statistics  from  G,  then  •  •  • ,  3^)  <at  ((j^-, '  ‘  ’  >  j^-)»  ■•eM  Y^Ai/ Y^X{  <-,f  Yt / ^ Yj 

t=i  1  j- 1  i=i 

for  k  =  1,2,  •  •  •  ,n. 


Theorem  2.4  yields  some  interesting  applications.  Choosing  the  Schur  function  <f>(t  1 ,  •  •  • ,  tn)  — 
nLt2  -  1,  we  obtain 


Y^(Xi  -  X)2 /X2  <at  ^2(Yi  -  Y)2/?2. 


(2.6) 


Choosing  the  Schur  function  <f>(t lf  •  ■  •  ,tn)  =  nHAiti/EU,ai  >  •  •  •  >  an,ti  >  •  •  •  >  t„.,  we  obtain 

^TAiXi/X  <9t  Y^AiYi/Y  (2.7) 

An  important  special  case  where  F  is  starshaped  with  respect  to  G  is  obtained  by  choosing 
<5(x)  =  e~x  and  F  to  be  IFRA.  The  statistical  applications  of  (2.6)  in  the  problem  of  testing  the 
hypothesis  that  F  is  exponential  versus  the  alternative  that  F  is  IFRA,  i.e.,  logF(x)  is  concave 
where  finite,  and  applications  of  (2.7)  in  testing  for  outliers  when  the  distribution  is  known  to  be 
IFRA  are  discussed  by  Marshall  et  al  (1967). 

3.  STOCHASTIC  COMPARISONS  OF  ORDER  STATISTICS  FROM  HETEROGENEOUS 
DISTRIBUTIONS. 

A  great  body  of  statistical  literature  exists  for  order  statistics  from  a  single  underlying  dis¬ 
tribution.  See  for  example  Sarhan  and  Greenberg  (1962),  Pyke  (1965,  1970),  David  (1970,  1986), 
Groeneveld  (1982),  and  references  contained  therein.  The  results  involving  order  statistics  from 
underlying  heterogeneous  distributions  are  far  fewer.  One  motivation  for  considering  underlying 
heterogeneous  distributions  arises  in  reliability  theory,  when  one  studies  fc-out-of-n  systems.  A 
system  of  n  components  is  called  a  fc-out-of-n  system  if  it  functions  if  and  only  if  at  least  fc 
components  function.  See  Barlow  and  Proschan  (1981).  Note  that  the  time  of  failure  of  a  fc- 
out-of-n  system  of  independent  components  with  respective  life  distributions  Fi,  F2,  ■  •  • ,  Fn  cor¬ 
responds  to  the  (n  —  fc  +  l)tAl  order  statistic  from  the  set  of  underlying  heterogeneous  distributions 
{Fi,F-2,  •  •  • ,  Fn}.  Sen  (1970)  proved  that  the  smallest  (largest)  order  statistics  of  a  sample  of  size  n 
from  heterogeneous  populations  is  stochastically  smaller  (larger)  than  the  smallest  (largest)  order 
statistic  of  a  sample  of  size  n  from  a  common  population  whose  distribution  is  the  equally  weighted 
mixture  of  the  original  distributions  Ft,F2,  •  •  • ,  Fn.  Let  X(ij  <  •••  <  <  F(n))  be 

the  order  statistics  of  n  independent  random  variables  Xi,  X2,  •  •  ■ ,  Xn(Yi,  Y2,  ■  ■  ■ ,  Yn)  with  dis¬ 
tribution  functions  Iri,  F2,  •  ■  • ,  Fn(Gi,  G2,  •  •  •  Gn)  respectively.  A  result  of  Sen  (1970)  concerning 
stochastic  relationship^  between  order  statistics  is  the  following. 

n 

Theorem  3.1.  Let  Gt(x)  =  •••  =  Gn(x )  =  ^^F,-(x).  Then 

»=i 

X(D  <•*  F(l)  and  x[n)  >‘'y(n). 


Additional  results  are  obtained  by  Pledger  and  Proschan  (1971),  wherein  they  assume  that  the 
distribution  functions  in  the  heterogeneous  case  have  proportional  hazard  functions.  In  some  of 
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their  comparisons,  the  underlying  heterogeneous  distributions,  less  heterogeneous  in  the  sense  of 
majorization.  Pledger  and  Proschan  also  compare  stochastically  spacing  between  order  statistics. 


The  simplest  comparisons  of  A>out-of-n  systems  can  be  made  by  taking  fixed  component 
reliabilities,  pl,p2,  •  •  • ,  p„,  rather  than  time-dependent  component  reliabilities  Fi(t),  •  •  * ,  F2(t). 
We  denote  the  system  reliability  of  a  A:-out-of-n  system  hk(pi,  •  •  •  ,pn)  as  a  function  of  component 
reliabilities  pi,  •  •  •  ,pn-  For  component  reliability  p»  we  define  the  corresponding  component  hazard 
Ri  by 

Ri  =  -\ogpi.  (3.1) 


By  using  notions  of  majorization  and  Schur  function  (see  Section  2),  Pledger  and  Proschan  (1971) 
obtain  the  following  inequalities. 


Theorem  3.2.  Let  R  =  (Rlf  ■  ■  • ,  i^)  be  a  vector  of  component  hazards  which  majorizes  R*  = 
(Rf,  •  •  • , J?*),  a  second  vector  of  component  hazards.  Then  the  corresponding  reliabilities  for  a 
fc-out-of-n  system  satisfy 

Mp)  >  hk(p*)  for  k  =  l,-*-,n  -  1  (3.2) 


and 


Mp)  =  Mp*). 


(3.3) 


For  a  fixed  vector  p  of  component  reliabilities  they  also  prove  hk(p)  is  a  Polya  frequency  sequence 
of  order  2{PF2)  in  the  index  k,  i.e.,  h\{p)  >  hk-i[p)hk+i(p)  for  k  =  2,  •  •  • ,  n  —  1.  See  Karlin 
(1968)  for  discussion  of  PF2. 


The  results  concerning  time-dependent  models  follow  immediately  by  setting  p,-  =  Fj  (t)  and 
p*  =  F*(t).  We  assume  independent  observations,  one  observation  from  distribution  Fi(F*),i  = 
1,  2,  •  •  ■ ,  n.  The  ordered  observations  are  again  denoted  by 
From  Theorem  3.2  the  following  can  be  obtained. 


Theorem  3.3.  (Pledger  and  Proschan,  1971).  Let  (- log  Fj(t),  •  •  • ,  -  log  Fn(t))  >m  (-IogF^t), 
•  •  • ,  -  log  F*(t))  for  each  t  >  0.  Then  AT(1(  =**  an^  ^(fc)  A'*fc)  for  k  =  2,  •  ■  ■ ,  n. 


Note  that  by  interchanging  F{  and  Fi  and  P(Xk  >  t)  and  P(X(fl_fc+1)  <  t ),  we  can  derive 
the  dual  of  Theorem  3.3:  Let  (- log  Fi(t),  •  •  • ,  -  log  Fn(t))  >m  (- log  Ff{t),  log  Fr*(t))  for 


'fit 


each  t  >  0.  Then  X^k)  X*k]  for  k  —  1,  •  ■  • ,  n  —  1  and  X{ 


(M 


1  (n) 


ft 


X? 


1 


If  Fk(t),i  =  1,  •••,«,  are  all  equal  to  the  geometric  mean  of  the  Fi(t),  ■  •  • ,  Fn(t),  then 
-X’(fc)  X*k)  for  k  =  1,  •  •  •  ,n;  in  particular,  =4t  X*y.  Likewise,  if  F*  (t)  =  •••  =  F*(t )  = 

n 

[JJf,(£)] 1//n  for  t  >  0,  then  X <4t  X*k^  for  k  =  1, 2,  •  •  ■ ,  n;  in  particular,  X(nj  =a* 

»=i 

In  keeping  with  (3.1)  of  hazard  in  the  non  time-dependent  case,  we  define  the  hazard  function 
R(t)  corresponding  to  survival  probability  F(t)  in  the  time-dependent  case  by 

R(t)  =  —  log  F(t )  for  t  >  0.  (3.4) 

We  say  hazards  are  proportional  if  hazard  #,(£)  may  be  expressed  as 

Ri(t)  =  A iR(t)  for  t  >  0, A»  >  0,t  =  1, •  •  •  ,n,  (3.5) 

where  R(t)  is  a  hazard  function. 

The  concept  of  proportional  hazard  functions  is  a  very  useful  one  in  reliability  theory.  Assume 
that  the  heterogeneous  distributions  have  proportional  hazards  Ri[t)  =  A iR(t)  and  R*(t)  = 
X*R(t),i  =  1,2,  where  R(t)  is  a  hazard  function  and  that  A  >m  A*.  Then  one  can  easily 

see  that  A  >m  A*  implies 

(—  log Fi(t), •  •  • ,  —  log Fn{t))  >«  (-logFr(t),---,-logF:(t)) 

for  each  t  >  0.  Therefore,  by  Theorem  3.3,  we  have  —3t  and  X(fc)  >at  X*k) ,  k  =  2,  •  •  •  n. 
We  state  this  result  in  the  following  theorem. 

Theorem  3.4  (Pledger  and  Proschan,  1971).  Let  Fi,  •  •  • ,  Fn;  F* ,  ■  ■  • ,  F*  have  proportional  hazard 
functions  with  Ai,  •••,  An;  AJ,  •••  A^  as  constants  of  proportionality.  Let  A  >m  A*.  Then  =ft 
AT(  1 1  and  X^k ^ ,  k  —  2,  •  •  • ,  n. 

Another  interesting  stochastic  comparison  can  be  obtained  when  survival  probability  is  log¬ 
arithmically  convex  in  the  parameter  A.  Consider  survival  probability  F(t,  A)  =  G(A£),  where  G 
has  DFR  and  A  occurs  as  a  ~cale  factor.  It  is  a  well  known  fact  that  a  DFR  survival  probability  is 
log  convex  (See  Barlow  and  Proschan,  1981,  Chapter  3).  Some  examples  of  DFR  survival  prob¬ 
ability  are  Weilbull  and  gamma  when  shape  parameters  are  <  1.  Also  a  mixture  of  exponential 
distributions  has  DFR;  see  Barlow  and  Proschan  (1981),  Chapter  4. 

Theorem  3.5.  (Pledger  and  Proschan,  1971).  For  t  >  0  let  (F(t,Aj))  be  differentiable,  monotone, 
and  log  convex  in  A»  >  0,  i  =  1, 2,  •  •  • ,  n.  If  A  >m  A*,  then  X(fc)  >'t  {<'t)X*k)  for  k  =  1,  •  •  • ,  n. 


Furthermore,  if  F(t,  A i)(F(t,  A»))  is  differentiable  and  log  concave  in  A»  >  0,  i  =  1,  •  •  •  ,n,  and 
A  >-  A*,  then  X(n)  >'*  X*n)(X(1)  <•*  X*l}). 

The  above  comparisons  for  the  largest  and  smallest  order  statistics  also  hold  for  parallel  and 
series  systems. 

Next  we  discuss  comparisons  of  spacings  arising  from  a  single  set  of  order  statistics  as  well  as 
the  spacings  arising  from  heterogeneous  distributions.  We  assume  the  underlying  heterogeneous 
distributions  have  proportional  hazards  Aii?(i),  •  •  • ,  XnR(t). 

Let  D i  =  X(1),D2  =  X(2)  —  X( =  X(n)  —  denote  the  spacings  between 

order  statistics  of  independent  observations,  one  from  each  of  n  heterogeneous  distributions.  We 
may  recall  that  when  the  observations  come  from  a  single  underlying  exponential  distribution  F, 
then  the  normalized  spacings  nDi,(n—  1)D2, ,Dn  are  independently  distributed  according  to 
the  same  exponential  distribution  F  and  are  stochastically  alike,  i.e.,  nDi  =et  (n  —  1  )D2  =>t 
■  ■  •  —at  Dn.  More  general  results  have  been  obtained  by  Pledger  and  Proschan  (1971)  when  the 
underlying  distributions  have  concave  proportional  hazards.  They  show  the  normalized  spacings 
increase  stochastically. 

Theorem  3.6.  Let  Fi(t)  =  e— A*-R(t) ,  A,-  >  0  for  t  =  1, •  •  • , n,  where  R(t)  is  concave  and  differen¬ 
tiable.  Then  nDi  <**  (n  —  l)D2  <at  <at  Dn. 

Define  D* ,  i  =  1,  •  •  • ,  n  to  be  the  spacing  arising  from  {F£ ,  •  •  •  ,F*},  the  second  set  of  expo¬ 
nential  distributions.  Pledger  and  Proschan  (1971)  obtain  the  following  comparisons  of  two  sets 
of  spacings. 

Theorem  3.7.  Let  Fi(t)  =  e~x,t,  and  F*(t)  =  e-*4,  for  i  =  1,2,  ••*,«,  where  A  is  the  arithmetic 
mean  of  the  A i ,  •  •  • ,  An.  Then  £>i  =st  D\  and  D>  >at  D*  for  t  =  2,  •  •  • ,  n. 

Note  that  the  mean  A  is  used  for  the  comparison.  A  natural  question  to  ask  is:  Is  the  same 
conclusion  possible  using  a  vector  A*,  where  A  >m  A*?  The  conclusion  need  not  hold  when 
A  >m  A*.  A  counterexample  is  provided  in  their  paper. 

An  application  of  the  results  of  this  section  to  a  reliability  problem  is  as  follows.  A  A;-out-of-n 
system  is  to  be  designed  from  supposedly  like  units.  However,  due  to  random  fluctuations  in  the 
units,  the  individual  unit  reliabilities  actually  vary.  From  a  knowledge  of  the  average  reliability 
of  the  units,  we  wish  to  predict  conservatively  the  reliability  of  the  system  of  unlike  units.  The 


theorems  in  this  section  describe  conditions  under  which  we  may  obtain  such  a  conservative 
prediction. 

4.  STOCHASTIC  COMPARISONS  OF  VECTORS  OF  ORDER  STATISTICS. 

The  results  discussed  so  far  present  stochastic  comparisons  between  an  individual  order  statis¬ 
tic  from  heterogeneous  populations  and  the  corresponding  statistic  from  a  homogeneous  popula¬ 
tion. 

In  this  section  we  review  stochastic  comparisons  of  pairs  of  vectors  of  order  statistics  from 
heterogeneous  populations.  This  stochastic  vector  comparison  yields  as  special  cases  the  Pledger- 
Porschan  theorems  described  above  and  additional  results  stochastically  comparing  partial  or 
complete  sums  of  order  statistics. 

Definition  4.1.  A  function  /  defined  on  Rn  is  said  to  be  increasing  if  it  is  increasing  in  each 
argument. 

Definition  4.2.  The  random  vector  X  =  (Xj.,  •  •  • ,  Xn)  is  said  to  be  stochastically  smaller  than 
the  random  vector  X*  =  (X*,---,X*),  (denoted  by  X  <at  X*)  if  /(X)  <at  /(X*)  for  every 
real- valued,  Borel  measurable,  increasing  function  /  defined  on  Rn. 

It  is  well  known  that  X  <*t  X*  if  and  only  if  F(X  e  Bn )  <  P(X*  e  B)  f°r  every  upper  open 
subset  B  of  Rn.  (A  set  B  C  Rn  is  said  to  be  an  upper  set  if  a  e  B  and  a  <  6  implies  b  e  B .) 

Sufficient  conditions  for  the  stochastic  comparison  of  two  random  vectors  are  given  by  Shan- 
thikumar  (1987).  His  conditions  are  weaker  than  those  of  Veinott  (1965),  and  of  Arjas  and 
Lehtonen  (1978). 

Given  a  vector  X  =  (Xi,  •  •  • ,  X„),  let  X(i)  <  •••  <  Xj„)  denote  an  increasing  rearrangement 
of  the  coordinates.  We  denote  the  vector  (X^),- •  •  ,X(„>)  by  X(  >.  Proschan  and  Sethuraman 
(1976)  investigate  stochastic  comparisons  of  various  functions  of  X(  j  =  (X(  1( ,  ■  •  • ,  X(n|)  with 
similar  functions  X*  j  =  (X*tj,  •  •  •  y^*n))  under  suitable  conditions  on  F i,  Fo,  •  ■  ■ ,  Fn;  F*,  •  •  • ,  F*. 
We  state  the  main  theorem. 

Theorem  4.1.  (Proschan  and  Sethuraman,  1976).  Let  Fl(  •  •  • ,  F„;  Ff ,  •  •  • ,  F^  have  proportional 
hazard  functions  with  Ai,  •  •  • ,  An;  A*,  •  •  • ,  A*  as  the  constants  of  proportionality.  Let  A  >rn  X* , 
Then  X(  )  >st  X*  ).  A  special  caise  involving  exponential  distributions  can  be  readily  obtained. 
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Theorem  4.2.  (Proschan  and  Sethuraman,  1976).  Let  Yi,  ■  ■  • ,  Yn(Y* ,  ■  ■  •  Y*)  be  independent 
exponential  random  variables  with  parameters  Ai,  •  •  • ,  An(A*,  •  •  • ,  A* ),  respectively.  Let  A  >m  A* . 
Then  Yn>’*Yiy 

Theorem  4.1  has  important  applications  in  reliability  and  life  testing  which  will  be  discussed 
later.  An  interesting  and  useful  special  case  of  Theorem  4.1  is  given  as  follows  :  Since  ^^X(r)  is 

rtf 

an  increasing  function  of  X(  ^  for  each  subset  I  of  {1,2, ■  ,n}  under  the  conditions  of  Theorem 

k  k 

4.1  we  have  E*w  IX)-  Th»s  £x(r)  >at  ^^X*rj  for  r  =  1,2,  •••,&;  in  particular 

reJ  rtl  r=l  r=l 

XX>  >-<  xx,. 

t— 1  r=l 

Note  that  Theorem  3.4  is  an  immediate  consequence  of  Theorem  4.1,  since  X(r)  is  an  increas¬ 
ing  function  of  X(  )  for  r  =  1,  and  also  note  that  in  Theorem  3.4  the  order  statistics  are 

stochastically  compared  one  at  a  time. 

It  can  be  checked  easily  from  the  distribution  functions  of  the  X  and  X*  that  if  Ax  >  X2  > 
•  •  •  >  An  and  AJ  >  •  •  •  >  A* ,  then 

Xi  <4t  •  ••  <•*  Xn 


and 


XI  < 


fit 


< 


9  t 
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The  stochastic  ordering  above  has  been  achieved  by  ordering  the  parameters  of  the  distributions. 

u  n 

One  may  ask  whether  A  >m  A*  implies  ^^Xi  >at  ^~]X*.  An  affirmative  answer  is  given  by 

i—k  i=k 

Proschan  and  Sethuraman  (1976)  in  the  following. 

Theorem  4.3  Let  Ai  >  •••  >  An(AJ  >  •••  >  A*).  Let  Xi,  •  •  • ,  Xn(XJ ,  •  •  • ,  X*)  be  indepen¬ 
dent  random  variables  with  proportional  hazard  functions  and  with  constants  of  proportionality 
Ai,  •  •  • ,  An(AJ,  •  •  • ,  A* ),  respectively.  Let  A  >m  A*.  Then  for  each  k,  1  <  k  <  n, 

E  *>•<£>;. 

i=k  i-k 


Application  4.1.  An  important  application  of  Theorem  4.1  concerns  the  robustness  of  standard 
estimators  of  the  failure  rate  of  an  exponential  distribution  when  observations  are  actually  from 
heterogeneous  distributions.  Let  Y^,  -  •  •  ,Yn  be  i.i.d.  exponential  random  variables  with  failure 


rate  A.  Under  censored  sampling  in  which  observations  cease  at  the  rth  failure  (i.e.,  Type-II 
censoring),  the  standard  estimator  (UMVUE)  A  takes  the  form 

r 

«  =  '/£%  +  (»-*)!,  (4.1) 

1 

where  Yji)  is  the  tth  order  statistic  *  =  1,  •  •  • ,  n. 


Suppose  now  that  the  observations  actually  come  from  different  exponential  distributions, 
with  average  failure  rate  A.  To  be  specific,  let  be  independent  exponential  random 

n 

variables  with  failure  rates  AJ,  •  •  •  A* ,  respectively,  and  let  A  =  YX  jn.  Note  that  A(T)  in  (4.1) 

t—  i 

is  a  decreasing  function  of  Y ^  ).  Thus  it  follows  from  Theorem  4.2  that 


A(X)  >“  A(X*). 


(4.2) 


The  implication  of  (4.2)  is  that  the  estimate  A  in  (4.1)  tends  to  underestimate  the  average  failure 
rate  in  the  presence  of  heterogeneity.  Proschan  and  Sethuraman  (1976)  note  that  Theorem  4.2 
actually  gives  a  more  refined  conclusion:  The  greater  the  degree  of  heterogeneity  (as  reflected  by 

n 

majorization)  among  A*, •  •  • ,  A*  satisfying  A  =  ^A */n,  the  greater  the  underestimation  of  A. 

»=i 

Barlow  and  Proschan  (1967)  have  listed  estimates  for  A  under  various  sampling  schemes. 
These  estimates  are  of  the  form: 


MX)  = 


number  of  failures  observed 


(4.3) 


total  time  on  test 

It  can  be  seen  (See  Barlow  and  Proschan,  1967)  that  in  general  the  estimate  in  (4.3)  is  a  decreasing 
function  of  the  order  statistics.  Thus,  as  in  the  above  case  of  censored  sampling,  heterogeneity  of 
the  exponential  distributions  leads  to  underestimation  of  the  average  failure  rate  when  using  the 
estimate  in  (4.3). 


The  following  direct  applications  of  Theorem  4.1  are  discussed  by  Proschan  and  Sethuraman 
(1976). 


Application  4.2.  Let  Xi,  X2,  •  •  •  be  i.i.d  random  variables  having  a  VVeibull  distribution  with  shape 
parameter  a  >  0;  i.e.,  P(Xi  >  z)  =  e~x°  ,  1  >  0.  Let  u  =  (u  1 ,  •  •  • ,  un)  and  u*  =  (u* ,  •  •  • ,  u* )  be 
vectors  such  that  (uf01,  •  •  • ,  u“a)  >st  ((«t)_a,  •  •  ■ ,  («*)"“).  Then 

n  n 

(4.4) 

»=1  i- 1 
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IV 


From  the  Weibull  distribution  it  is  easy  to  see  that  uiXi,  ■  •  •  ,unXn  have  proportional  hazard 
functions  with  constants  of  proportionality  ufa,---,u“a,  respectively.  Thus  (4.4)  is  immediate 


from  Theorem  4.1. 


Application  4.3.  Let  Xp  denote  the  binomial  random  variable  with  P(Xp  =  l)  =  1  —  P(Xp  =  0)  = 
p.  Let  xPl,  —  ,xp  n  (Xpj ,  •  •  • ,  Xp* )  be  mutually  independent  and  let  (—  log  pi ,  •  •  • ,  —  log  pn)  >m 

n  n 

(-logPi,”-,-logp*).  Then  >st  J^XP*. 


We  note  that  Theorem  3.2  (Pledger  and  Proschan)  concerning  the  reliability  of  Jc-out-of-n 
systems  and  order  statistics  can  be  obtained  as  a  consequence  of  Application  4.3,  since  h^(p)  = 

n  ~~ 

p(£xr,  >  k). 


The  usual  definition  of  stochastic  comparison  of  random  vectors  has  been  extended  by 
Pledger  and  Proschan  (1973)  to  stochastic  comparison  of  random  processes.  We  call  stochas¬ 
tic  process  {X(t),£  >  0}  stochastically  larger  than  stochastic  process  {F(£),£  >  0}  (written 
{X(t),t  >  0}  >“  {Y{t),t  >  0}  if  (A’(«1),...,X(«n))  >*£  (F(ti),---y(tn))  for  every  choice  of 
o  <  <1,<  *2  <  •••  <  tn,n  =  1,2,  •••.  This  extended  comparison  permits  one  to  obtain  bounds 
not  just  on  a  few  parameters,  but  simultaneously  on  an  uncountably  infinite  class  of  functionals 
of  the  stochastic  process.  See  Pledger  and  Proschan  (1973)  for  applications  to  reliability  prob¬ 
lems,  yielding  stochastic  comparisons  for  systems  of  independently  operating  machines  assuming 
exponential  failure  and  exponential  repair. 


TOOTS 
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